BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Localization events by Approx. Span matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] Localization 174 ( 86) 105 ( 86) 49.43 81.90 61.65
[VIBGhent ] Localization 174 ( 76) 97 ( 76) 43.68 78.35 56.09
[JULIELab ] Localization 174 ( 76) 98 ( 76) 43.68 77.55 55.88
[UT+DBCLS ] Localization 174 ( 66) 75 ( 66) 37.93 88.00 53.01
[ConcordU ] Localization 174 ( 62) 67 ( 62) 35.63 92.54 51.45
[ UNIMAN ] Localization 174 ( 78) 147 ( 78) 44.83 53.06 48.60
[ UTokyo ] Localization 174 ( 55) 58 ( 55) 31.61 94.83 47.41
[ UAveiro ] Localization 174 ( 62) 88 ( 62) 35.63 70.45 47.33
[ASU+HU+BU] Localization 174 ( 57) 70 ( 57) 32.76 81.43 46.72
[CNBMadrid] Localization 174 ( 61) 114 ( 61) 35.06 53.51 42.36
[ UMich ] Localization 174 ( 80) 212 ( 80) 45.98 37.74 41.45
[ SCAI ] Localization 174 ( 48) 58 ( 48) 27.59 82.76 41.38
[ Cam ] Localization 174 ( 45) 50 ( 45) 25.86 90.00 40.18
[ Team 24 ] Localization 174 ( 48) 80 ( 48) 27.59 60.00 37.80
[ UNSW ] Localization 174 ( 40) 41 ( 40) 22.99 97.56 37.21
[ NICTA ] Localization 174 ( 42) 66 ( 42) 24.14 63.64 35.00
[UAntwerp ] Localization 174 ( 36) 46 ( 36) 20.69 78.26 32.73
[ KoreaU ] Localization 174 ( 35) 43 ( 35) 20.11 81.40 32.26
[CIPS-ASU ] Localization 174 ( 49) 143 ( 49) 28.16 34.27 30.91
[ UZurich ] Localization 174 ( 32) 34 ( 32) 18.39 94.12 30.77
[ PIKB ] Localization 174 ( 19) 23 ( 19) 10.92 82.61 19.29
[CCP-BTMG ] Localization 174 ( 18) 18 ( 18) 10.34 100.00 18.75
[ USzeged ] Localization 174 ( 14) 33 ( 14) 8.05 42.42 13.53
[ Team 09 ] Localization 174 ( 1) 1 ( 1) 0.57 100.00 1.14
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Localization 174 ( 57) 75 ( 57) 32.76 76.00 45.78
[ASU+HU+BU] Localization 174 ( 42) 70 ( 42) 24.14 60.00 34.43
[CNBMadrid] Localization 174 ( 49) 114 ( 49) 28.16 42.98 34.03
[ Team 24 ] Localization 174 ( 39) 95 ( 39) 22.41 41.05 29.00
[UAntwerp ] Localization 174 ( 31) 46 ( 31) 17.82 67.39 28.18
[CCP-BTMG ] Localization 174 ( 17) 18 ( 17) 9.77 94.44 17.71
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------